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CRAMER-TYPE LARGE DEVIATIONS FOR SAMPLES FROM 
A FINITE POPULATION 1 

By Zhishui Hu, John Robinson and Qiying Wang 

USTC, University of Sydney and University of Sydney 

Cramer-type large deviations for means of samples from a finite 
population are established under weak conditions. The results are 
comparable to results for the so-called self-normalized large deviation 
for independent random variables. Cramer-type large deviations for 
the finite population Student f-statistic are also investigated. 

1. Introduction and results. Let X±, X2, ■ ■ ■ , X n be a simple random 
sample drawn without replacement from a finite population {cl}n = • • • > ojv}, 
where n < N . Denote fi = EXi, a 1 = var(Xi ), 

n 

5 n = yjx fc , p = n/N, q=l-p, u? N = Npq. 

k=l 

Under appropriate conditions, the finite central limit theorem (see [14]) 
states that P(S n — nfi > xctojn) may be approximated by 1 — &(x), where 
<3?(x) is the distribution function of a standard normal variate. The absolute 
error of this normal approximation, via Berry-Esseen bounds and Edge- 
worth expansions, has been widely investigated in the literature. We only 
refer to [4] and [17] for the rates in the Erdos and Renyi central limit theorem 
and to [1, 3, 26], as well as [6, 7], for the Edgeworth expansions. Extensions 
to [/-statistics and, more generally, symmetric statistics can be found in 
[20, 21, 27, 28], as well as [9, 10]. 

In this paper, we shall be concerned with the relative error of P(S n — nji > 
xuojn) to 1 — In this direction, Robinson [25] derived a large deviation 
result that is similar to the type for sums of independent random variables 
in [22], Chapter VIII. However, to make the main results in [25] applicable, 
it essentially requires the assumption that 0<pi <p<P2 < 1- This kind of 
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condition not only takes away a major difficulty in proving large deviation 
results but also limits its potential applications. The aim of this paper is to 
establish a Cramer-type large deviation for samples from a finite population 
under weak conditions. In a reasonably wide range for x, we show that 
the relative error of P(S n — n\i > xctujn) to 1 — <&(cc) is only related to 
E\X\ — //| 3 /c7 3 by means of an absolute constant. We also obtain a similar 
result for the so-called finite population Student t-statistic defined by 

t n = y/n(X - fi)/(ay/q), 

where X = S n /n and a 2 = J2]=i(Xj — X) 2 /(n — 1). It is interesting to note 
that the results for both the finite population standardized mean and the 
Student t-statistic are comparable to the so-called self-normalized large de- 
viation for independent random variables which has recently been developed 
by Jing, Shao and Wang [19]. Indeed, Theorems 1.1 and 1.3 below can be 
considered as analogous to Theorem 2.1 of Jing, Shao and Wang [19] in the 
independent case. The Berry-Esseen bounds and Edgeworth expansions for 
the Student t-statistic have been investigated in [2], [23] and [5, 8]. 
We now state our main findings. 



Theorem 1.1. There exists an absolute constant A > such that 
exp{-A(l + x) 3 f3 3N /to N } < 



1 - <f>(x) 
(1.1) 

< exp{A(l + xf[3 3 N/uJ N } 
for < x < {1/A)ujno-/ maxfc |afe — fj,\, where (3 3 n = a~ 3 E\X\ — //| 3 . 

The following result is a direct consequence of Theorem 1.1 and provides 
a Cramer-type large deviation result for samples from a finite population. 

Theorem 1.2. There exists an absolute constant A > such that 

(12) p (s „ -y) _ t + p(1)(1 + x)3ftwAw 

and 

(1.3) $(- a ) = + + x > ^n/ujn 

for < x < (1/A) min{u;7va"/maxfc |a& — [x\,(ujn / Psn) 1 ^} , where 0(1) is 
bounded by an absolute constant. In particular, ifuj^/PsN — >oo, then, for 
any < i]n — > 0, 

P(S n -nn> xauj N ) P(S n -n[i< -xaiv N ) 

[ " ' l-$(s) ' $(-x) 

uniformly in < x < t]n min{a;jvc/ max^ |afe — fi\, (lun / ' (3 3 n) 1 ^} ■ 
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Results (1.2) and (1.3) are useful because they provide not only the rela- 
tive error, but also a Berry-Esseen rate of convergence. Indeed, by the fact 
that 1 — <£(x) < 2e~ x / 2 /(l + x) for x > 0, we may obtain 

\P(S n ~nn< x<tuj n ) - $(x)| < A{\ + \x\) 2 e~ x2 / 2 (3 3N /uj N 

for |x| < (1/A) mm{u)N(r/ max/,, |ojt — fi\, (lvn / Psn) 1 ^ 3 } ■ This provides an ex- 
ponential nonuniform Berry-Esseen bound for samples from a finite popu- 
lation. 



Remark 1.1. We do not have any restriction on the {a}/v in Theorems 
1.1 and 1.2. Indeed, for any {ci}n, 

N 1 N -i TV 



1 1 1W 1 " 

v = jrfY. a ki a =-Afl]( a fc-M) 2 . E \ x i- ^ = ^Y.\ a k- ^ 3 

k=l k=l k=l 

Removing the trivial case that all are the same, we always have max^ |a& — 
fi\ >0, a 2 >0 and E\Xx - fi\ 3 < oo. 

Remark 1.2. Hajek [15] proved that if < p\ < p < pi < 1, then (S n - 
nn)/au>N — >i) N(0, 1) if and only if u^a/ m&Xk |ofc — — > oo. Theorems 
1.1 and 1.2 therefore provide reasonably wide ranges for x to make the 
results hold. To be more precise, as an example consider = k a , where 
a > — 1/3. In this special case, simple calculations show that 

minj^/vcr/ max|a fc - (uj n / f3 3N ) 1/3 ^ x (Npq) l/& . 

Thus, Theorem 1.2 holds for x belonging to the best range (0, o[{Npq) l l & \). 

The following theorem provides a relative error of P(t n > x) to 1 — 3>(x), 
which is only related to E\X\ — /i| 3 /cr 3 by means of an absolute constant, 
as in Theorem 1.1. Cramer- type large deviation results for the Student t- 
statistic may be obtained accordingly, as in Theorem 1.2. We omit the de- 
tails. 



Theorem 1.3. There exists an absolute constant A > such that 
exp{-A(l + x) 3 fo N /uj N } < 



^3 /3 /..",/ P(tn>x) 



l-*(ac) 
(1.5) 

< exp{A(l + xf[3 3 N/uJ N } 

for all < x < (1/A)un<j / max^ \af. — y\, where flsiy is defined as in Theo- 
rem 1.1. 
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Table 1 

Relative errors of tail probability to normal 



Population 


N 


Np 


/33N 


x = 2 


x = 2.5 


x = 3 


CLk=k 


1000 


250 


1.299 


1.006 


1.041 


1.119 




100 


25 


1.299 


1.223 


1.562 


2.356 


Ok = k 2 


1000 


250 


1.376 


0.897 


0.807 


0.707 




100 


25 


1.375 


0.802 


0.783 


0.814 



Remark 1.3. The finite population {a}j\[ in Theorems 1.1-1.3 may be 
replaced by a triangular array {a} at = {aNi,i = 1,2, ... ,N},N > 2, without 
essential difficulty. Theorems 1.1-1.2 give information on normal approxi- 
mations for permutation and rank tests, while Theorem 1.3 is applicable in 
survey sampling. It is worthwhile to note that we did not introduce any re- 
strictions on unknown parameters or the sampled population and, by means 
of methods similar to those used in the proof of Theorem 1.3, it is possible 
to obtain similar bounds for the Studentized mean under stratified random 
sampling. 

Remark 1.4. The importance of Theorems 1.1-1.3 is based on the fact 
that all bounds are based only on E\X\ — /x| 3 /<r 3 with an absolute constant. 
The relevance of the results lies in the fact that they give general bounds 
on the relative errors of the normal approximation, in the same way as the 
Berry-Esseen bounds are of use in giving uniform bounds on the absolute 
error. However, our theorems are still asymptotic results, as the absolute 
constant A is not specified. The following simulations in Table 1, which 
provide the relative error of P(t n > x) to 1 — &(x) based on Theorem 1.3 for 
Ofc = k and = k 2 based on 1,000,000 repetitions, indicate the accuracy of 
the normal approximation in the large deviation region. The simulations in 
Table 2 confirm that more precise results, like saddle-point approximations, 
are required. Dai and Robinson [11] investigated saddle-point approximation 
under very strong conditions, that is, where errors are based on Ee l ^ Xl ^^ , 
for t > 0, with a constant. The saddle-point approximations under the weak 
conditions as in Theorem 1.3 are open problems. 

This paper is organized as follows. Major steps of the proofs of Theorems 
1.1-1.3 are given in Section 2. Proofs of three propositions used in the main 
proofs are offered in Sections 3-5. In Section 3, as a preliminary, we establish 
a Berry-Esseen bound for the associated distribution of P(S n — nfi < x) 
related to the conjugate method in a general setting. Throughout the paper, 
we shall use A, A\, A2, ■ ■ ■ to denote absolute constants whose values may 
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differ at each occurrence. We also write b = x/lon, V 2 = J2k=i 

n 

V ln = V 2 -n and V 2n = ]T[(X 2 - l) 2 - E(X 2 k - l) 2 ] 

k=l 

and, when no confusion arises, denotes Ylk=l ana - II denotes IlfcLi- The 
symbol i will be used exclusively for 

2. Proofs of theorems. Without loss of generality, we assume that fj, = 
and <t 2 = 1. Otherwise, it suffices to consider that {X\, X 2 , ■ ■ ■ , X n } is a 
simple random sample drawn without replacement from a finite population 
{ci'}n = {(ai — fi)/o,..., (oat — y)/cr}, where n< N. 

Proof of Theorem 1.1. When < x < 2, property (1.1) follows from 
the Berry-Esseen bound for samples from a finite population (see, e.g., [17]), 

\P(S n > xu N ) - (1 - $(x))\ < A(3- m /uo N . 

When 2 < x < (1/A)ujn/ maxj \ cik\, property (1.1) follows from the following 
proposition with £ = 0, £i = and h = 0. Proposition 2.1 will be proven in 
Section 3. □ 

Proposition 2.1. There exists an absolute constant A > such that, 
for all < £ < 1/2, |£i| < 36 and 2 < x < (1/A)un/ max^ \a,k\, 

(2.1 — — >exp{-Ax (3 3N iv N \ 

l — q?(x) 

and 

P(bS n - jb 2 qV ln + CifrV y 2w > x 2 + fc) 
1 - *(ar) 

(2.2) 

< [1 + 9|/i|x" 2 ]exp{-/i + ylx 3 /33 A r/u; A r}, 
where h is an arbitrary constant (which may depend on x) with \h\ < x 2 /5. 

Table 2 
Saddle-point approximations 



Population 


N 


Np 




x = 2 


a; = 2.5 


x = 3 


a k — k 


1000 


250 


1.299 


0.984 


0.989 


1.011 




100 


25 


1.299 


0.996 


0.989 


0.992 


a k = k 2 


1000 


250 


1.376 


1.010 


0.987 


0.966 




100 


25 


1.375 


0.991 


1.007 


1.009 
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Proof of Theorem 1.2. This follows immediately from Theorem 1.1. 

□ 

Proof of Theorem 1.3. When < x < 4, property (1.5) follows from 
the Berry-Esseen bound for the finite population Student t-statistic; see, 
for example, [5]. Next, assume 4 < x < (1 / A)u)]\[ / max^ |afc|. Without loss 
of generality, assume that A > 8 and n > 4. Note that max^ |a^| > 1, since 

a\ = N. It is readily seen that 



(2.3) 



_ 1 



|[l + (x 2 <?-l)/np 1/2 -l| < 2x 2 /ra, 



where Xq = xn 1 / 2 /(n + x 2 q — l) 1 / 2 . It follows from (2.3) that 2 < x/2 < xq < 
3x/2 and \xq — x\ < 2x 3 Psn/uj%. Hence, by noting 1 — <£(x) > x&(x)/(l + x 2 ) 
for x > (see, e.g., [24], page 30), we have 

rx i +t 2 



log 



1 - Hx ) 



1 - $(x) 



■dt 



< 



l-*(t) 

< 2x|x — xq| < x 3 /33n/^n, 



dt 



which yields that 



(2.4) 



exp{-x 3 p 3N /tJ N } < 



l-$(sp) 



< exp{x 3 f3 3N /uj N }. 



We are now ready to prove Theorem 1.3. As is well known (see, e.g., [13]), 
for x > 0, 

P(t n >x) = P(S n /V n >x y/q). 

Note that b x y/qV n < (x§ + b\qV 2 )l2 < x 2 , + b\q(y 2 - n)/2, where b = 
xq/u>n. It follows from (2.1), (2.3) and (2.4) that, for 4 < x < (1/A)ujn/ max^ \cik\, 

P(S n > x 0y /qV n ) > P(b S n - b 2 q(V 2 - n)/2 > x 2 ) 

> (1 - <5>(x ))exp{-Axlf3 3N /uj N } 

> (1 - $(x)) exp{-Aix 3 /3 37V /w7v}, 

which implies the first inequality of (1.5). 

In view of the following two propositions, the second inequality of (1.5) 
may be obtained by an argument similar to that used in the proof of (5.13) 
in [19], so the details are omitted. The proofs of Propositions 2.2 and 2.3 
will be given in Section 4 and Section 5, respectively. □ 

Proposition 2.2. There exists an absolute constant A > such that 
P(S n > x^W n ) < (1 - $(x)) exp{Ax 3 /? 3 7vMv} + Ae~^ 
for 2 < x < (l/A)wAr/maxfc \a^\. 
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Proposition 2.3. There exists an absolute constant A > such that 
P(S n > xjqVn) < (1 - <f>(x))exp{Ax 3 (3 m /u; N } + A(x(3 3N /co N f 3 
for 2 < x < (1/A)un/ maxfc \ak\ ■ 

3. Proof of Proposition 2.1. In Section 3.1, we derive a Berry-Esseen 
bound for the associated distribution of P(S n < x) related to the conjugate 
method. The result is established in a general setting and will be used in 
the proof of Proposition 2.1, which is given in Section 3.2. 

3.1. Preliminary. Consider a sequence of constants {b} n = {bi, . . . , 
with J2h = 0. Write K(z) = \og(pe qz + qe~ pz ) and let K k ,K' k and K'£ be 
the values of K(x),K'(x) and K"(x) evaluated at x = ubk + ajy, where on 
is the solution of the equation 

(3.1) ^K'(ub k + a) = 0. 

We continue to assume that X± , X2 , • • • , X n is a random sample without 
replacement from {b} at, where n < N, and continue to use the notation 
S n = J2k=i Xk, P, Q and oj 2 n = Npq, as in Section 1. Define 

H n {x-u) = Ee uS "I(S n < x)/Ee uS ". 

The main result in this section is as follows. 



Theorem 3.1. For any given Cq > 0, if \u\ < Co/ max^. \bk\, then 



(3.2) sup 

X 

and 



H n (x;u)-<f> 



x — mjy 

0~N 



<c( Pq )-^\h\ 3 /(Y.t>t) 



\ 3/2 



(3.3) Ee^ = (G^r 1 (JT K£) ^ exp{^ K k }(l + O l / 
where G n (p) = ^( N n )p n q N - n , m N = EhK' k 



I Oi| is bounded by C\ and both C and C\ are constants depending only 
on Co. 

The results (3.2) and (3.3) essentially improve Lemma 2 and Lemma 1 
(with v = 0) of [25], respectively. In [25], the constants C and C\ are imposed 
to depend on p and q. The proof of Theorem 3.1 follows the approach of 
Robinson [25], but with quite different calculations. The details can be found 
in [18], on which the present paper is based. 
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3.2. Proof. Roughly speaking, the proof of Proposition 2.1 is based on 
the conjugate method and an application of Theorem 3.1 to the bk specified 
in (3.4) below. 

Let < A < 2, < 6 < 1 and |6>i| < 72. Define, for k = l,...,N, 



(3.4) b k = Xba k - 8b 2 q(al - 1) + O^q 2 



(«i-D 2 -^EK 2 -D 



Since X)°fc = and J2af, = N, it is readily seen that max^ \ak\ > 1 and 
J^bk = 0. Also, when bm&Xk |afc| < 1/128, we have that b(3zN < 1/128, 

(3.5) max|6 fe | < 1/32, 

k 

(3.6) ~ X 2 b 2 N\ < 5Nb 3 q(3 3N , 

(3.7) El^l 3 ^ 9 ^ 3 ^- 

Recalling b = x/lon , (3.5)-(3.7) hold if < x < (l/128)w7v/maxfc \ak\- 

We establish five lemmas before proceeding to the proof of Proposition 
2.1. The first lemma summarizes some basic properties of K{z). We still 
use the notation K^, K' k and K' k ' to denote the values of K(z), K'(z) and 
K"(z) evaluated at z = bk + a^, where the bk are limited to (3.4) and is 
the solution of the equation Y^K'{bk + a) = 0. Lemmas 3.2 and 3.3 give the 
properties of a^, K^, K' k and K k . Lemmas 3.4 and 3.5 provide the results 
that will be used in the proof of Proposition 2.1. 

Lemma 3.1. We have K'(0) = 0, 

(3.8) - pqe 2t < K'(-x) < < K'{x) < pqe 2t , for0<x<t, 

(3.9) pqe~ 3t < K"{x) < pqe 3 \ for \x\ < t, 

(3.10) \K"'(x + iy)\ < 2 3/2 e 5t pq, for \x\ < t and \y\ < vr/2. 
Furthermore, if \x\ < 1/16, then 

(3.11) \K{x)/pq - x 2 /2\ < (l/2)|x| 3 , 

(3.12) \K'(x)/pq-x\ <x 2 , 

(3.13) \K"{x)/pq-l- (q-p)x\<8x 2 . 

Proof. The proof of Lemma 3.1 is straightforward and the details are 
omitted. □ 

Lemma 3.2. IfO < x < (1/128)lvn / m&Xk \ak\, thenar is unique, 

(3.14) \a N \ <min{l/32, (2/JV)^&£} and a 2 N < (9/8)b 3 p 3N . 
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PROOF. By virtue of (3.5), (3.8) and (3.9), J2 K '(b k + a) is negative 
when a < —1/32 and positive when a > 1/32, and it is strictly monotone 
in the range \a\ < 1/32. This implies that ^K'{b k + a) = has a unique 
solution ajv and that |ckjv| < 1/32. By noting \b k \ + \&n\ < 1/16, it follows 
from (3.12), £ K'(h + «jv) = and £ 6 fc = that 

N\a N \ = \ *T[ K '(h + a N )/pq - (b k + a N )] 
<Y;(h + a N ) 2 = Y,bl + Na 2 N 
<J2bl + N\a N \/2. 

This yields |ajv| < (2/N)J2b 2 and hence the first result of (3.14) follows. 
Furthermore, by using Holder's inequality, \b k \ < 1/32 and (3.7), we obtain 

a 2 N <^/N)J2bt<(9/8)b 3 (3 3N , 

which implies the second result of (3.14). The proof of Lemma 3.2 is com- 
plete. □ 

Lemma 3.3. IfO < x < (l/128)o;jv/rnaxfe \a k \, then 

(3.15) \Y,K k - X 2 x 2 /2\ < 24x 3 (3 3N /u N , 

(3.16) \Y / b k K' k -X 2 x 2 <24x 3 P 3N /uj n , 



(3.17) 
(3.18) 
(3.19) 



<41x' 



< 6x z 



\j2 b l K k - X 2 x 2 < 21x 3 (3 3N /lo n . 



Proof. We prove (3.15). The other proofs are similar and hence are 
omitted. Applying (3.11) with x = b k + and using Holder's inequality, 
we obtain 



(3.20) \Y}K k -2' l pq{b k + a N ) 2 ] < 2pgQT \b k \ 3 + N\a N \ 3 
This, together with = 0, (3.6)-(3.7) and (3.14), implies that 
|]T K k - \ 2 x 2 /2\ < \Y}K k - 2~ l pq(b k + a N ) 2 

+ 2~ 1 pq\Y J b 2 k - \ 2 b 2 N\ +2~ 1 to 2 N a 2 N 
< 24b 3 uj 2 N (3 3N = 24x 3 P 3N /uj n , 



as required. □ 
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Let Yj, 1 < j < n, be a random sample of size n without replacement from 
{bi,b 2 , - ■ ■ ,b N } denned by (3.4), 

n 

T* = T n (X, 9, 00 = Y k, rn* N = m N (X, 9, X ) = £ b k K' k , 

k=l 

a* N 2 = o%{\, 9, X ) = £ blK'l - (£ b k K'tf / £ «2 
and = £exp(T*)/(T* < x)/£exp(T*). 

Lemma 3.4. There exists an absolute constant Xq > sitc/i £/ia£, /or 
2 < x < Xqujn / maxfc \a k \, 

exp{A 2 z 2 /2 - Ar 3 /? 3 ;vMv} < £exp(T*) 

(3.21) 

< exp{\ 2 x 2 /2 + Ax s f3 3N /uj N }. 

Proof. Without loss of generality, assume that Ao < min{ 1/128, 1/(8C\ + 
4)}, where C\ is defined as in Theorem 3.1. Recall that max^ \b k \ < 1/32, by 
(3.5). It follows from (3.3) (Theorem 3.1 with u = 1 and Co = 1/32) that 

(3.22) i?exp(T ? :) = (G n ,(p))- 1 (^^)" 1/2 exp|f;^ fc |(l + i?*), 
where G n (p) = ^{*)p n q N ~ n and |JT| < Cx/u N . By Stirling's formula, 

(^Y--(24)- 1/2 (i+o 2 % 2 ), 

where \0%\ < 1/6. This, together with the fact that lon > xmax^ |ctfc|/Ao > 
128 (recall that maxfc |ajfc| > 1), implies that 

(3.23) ^ 1 C n (p)- 1 (l + i?*) = l + 3 ^ 1 , 

where | O3 1 < 2C\ + 1. On the other hand, it follows from (3.17) that 

(3.24) (J2 K'l) ~ 1/2 ^n = 1 + O40 2 , 

where | O4 1 < 82. From (3.23)-(3.24), for 2 < x < Xq^n / max^ \a k \, 

exp{-2A lX 3 f3 3N /u N } < (^^) -V2 G n (p)- 1 (l + R*) 

(3.25) 

< exp{Aix Pzn/un}, 

where A\ = 2C\ + 83 and where we have used the fact that 1 / u>n + b 2 < 
x 3 P3n/^n, since b = x/u>n and (5 3 n > 1- (3.21) now follows easily from 
(3.15), (3.22) and (3.25). The proof of Lemma 3.4 is thus complete. □ 
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Lemma 3.5. There exists an absolute constant Ai > such that, for 
2 < x < \\ojn / maxj. \d}-\, 

(3.26) \m* N - X 2 x 2 \ < 24x 3 P 3N /lo n , 

(3.27) \a* N 2 - \ 2 x 2 \ < 22x 3 P 3N /lo n . 
If, in addition, 1 < A < 2, then 

(3.28) A N :=sup\H*(u(y))-$(y)\ < 12 Cf3 3N /uj N < 1/4, 

y 

where u(y) = ya* N + m* N and where C is defined as in (3.2). Also, for all y 
satisfying m* N >y + 2a* N , we have 

(3.29) P{T* >y)> (l/2)exp{-m*v - 2a* N }Eex V {T*). 

Proof. Without loss of generality, assume that Ai < min{l/128, 
1/(25C)}, where C is defined as in (3.2). (3.26) and (3.27) then follow from 
(3.16)-(3.19) by a simple calculation. 

If 1 < A < 2, then by noting that I3 3 n/^n < xfizN / (2ojn) < min{l/128, 
1/(50C)}, since (3 3 n < max^ |afc|, it follows easily from (3.5)-(3.7) that pqJ2^k — 
4x 2 /5 and 

(3.30) (m)" 1/2 E l^l 3 /(E ft i) 3/2 < Wzn/uj n < 1/(4C). 

By (3.30) and Theorem 3.1 with Cq = 1/32 and u = 1 (recall that max^ \ bk\ < 
1/32), 

A N <C(pq)- l / 2 J2\bk\ 3 /(Y, b iy /2 <UCfo N /u N < 1/4, 

which implies (3.28). 

By (3.28) and the conjugate method, for all y satisfying m* N >y + 2a* N , 

P(T* > y)/Eexp(T*) = / e~ u dH*(u) 

Jy 

e~™« dH* n (u(y)) 

(y- m * N )/ a N 
r 2 

> e - m N- 2a N J dH* n {u{y)) 

> (l/2)exp{-m* N -2** N }, 

where N(0, 1) is a standard normal random variable and where we have used 
the fact that 

P(|iV(0,l)| <2) >3/4. 
This proves (3.29) and also completes the proof of Lemma 3.5. □ 



> e- m N- 2a N(p(\N(0,l)\ <2) - Aj 
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After these preliminaries, we are now ready to prove Proposition 2.1. 
In addition to the previous notation, we further let T\ n = T n (l,£,£i), 

mi N = m N (l,£,£ 1 ), crl N = cr%(l,€,€i), e N = (x 2 + h - m 1N )/a 1N 

and H ln {t) = E exp{T ln } I (T ln < t) / E exp{T ln } . Note that 

bS n - & 2 qV ln + ^b 4 q 2 V 2n = T ln . 

It follows from the conjugate method that 

P(bS n - ib 2 qV ln + ^b\ 2 V 2n >x 2 + h) 

= P{Tm >x 2 + h) 

POO 

= Eexp{T ln } e- l dH ln {t) 

Jx 2 +h 



(3.31) 



where 



2 u f°° 

Eexp{T ln }e~ x ~ h / e~ taw dH ln [a 1N (t + e N ) + m 1N ] 
Jo 



10 

Eexp{T ln }e~ x2 - h (C N + R N ) 



poo 

£n= / e~ taiN d$(t + e N ), 
Jo 

POO 

Rn= / e~ taiN d{H ln [a 1N (t + e N )+m 1N ]-$(t + e N )}. 
Jo 

We next estimate Eex.p{Ti n }, Cn and Rn for < £ < 1/2, < 36, 
\h\ < x 2 /5 and 2 < x <tjlon / max/,. |%|, where we assume r\ to be sufficiently 
small so that r/ < min{l/128, Ao, Ai}, with Ao and Ai defined as in Lemmas 
3.4 and 3.5. This choice of rj guarantees that Lemmas 3.2-3.5 hold and, since 
@3N < max/j | | , we have 

(3.32) 03n/wn < x(3 3N /{2uj n ) < V /2 < 1/256. 

Clearly, by Lemma 3.4, 

exp{j; 2 /2 - Ax 3 P 3N /oj n } < £exp{Ti n } 

(3.33) 

< exp{x 2 /2 + Ax 3 /3 3N /u N }. 
In order to estimate Cn, we note that 

1 



Cn =' e -a N t-(l/2)(t+e N y dt 

V2tt Jo 



(3.34) = *—^L I" e ~(e N+ a N )t-(l/2)fi dt 



-£in- 



2n 
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Write V(t) = {1 - &(t)}/& (t) = e t2 / 2 f t °° e"^/ 2 dy. It is readily seen that 
3/4<t^(t)<l (t>2), 

(3.35) 

\ij}'(t)\ = \tip(t)-l\<t- 2 (t>0). 

On the other hand, V'{eAr + o^r} = £iat and, by virtue of (3.26), (3.27) and 
(3.32), it follows that 

(3.36) \e N - h/a N \ < 28x 2 (3 3N /uj n . 
If, in addition, we have \h\ < x 2 /5, then 

(3.37) \e N + a N - x\ < 3\h\/{2x) + Alx 2 p 3N /u N < 2x/3. 

Using (3.35)-(3.37), it follows from Taylor's expansion that, for \h\ < x 2 /5 
and 2 < x < tjcon / max& |a&|, 

Cm = ip{£N + cr N } 

= ip(x) + if)'(9){e N + a N - x} [where 9 G (x/3, 5x/3)} 
= tp{x)(l + t + 5 x(3 3N /lu n ), 

where |r| < 9\h\/x 2 and \0^\ < 120. Therefore, taking account of (3.34), we 
obtain for \h\ < x 2 /5 and 2 < x < tjlun/ maxj. \ak\, 

(3.38) C N = e x2 l 2 {l - <K(x)}e-^/ 2 (l + r + 5 */WM- 

As for Rn , by (3.28) and integration by parts, 

|#iv| < 2 sup \H ln [a 1N t + muv] - < 24Cp m /u N . 
t 

This, together with (3.35), implies that for x > 2, 

(3.39) iiiv = 6 ^3iv/w7ve x2/2 {l - 

where |0 6 | < 32 V / 2^C. 

Combining (3.31), (3.33) and (3.38)-(3.39), it is readily seen that for any 
\h\ < x 2 /5 and 2 < x < rjujj^/ max^ |afc|, 

P{bS n - jb 2 qV ln + gi&VU 2ra > x 2 + h) 

< [1 + 9\h\x~ 2 } exp{-/i + Ax 3 (3 3N /^n}- 

This proves (2.2). 
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Similarly, by letting h = 0, it follows from (3.31), (3.33), (3.36), (3.38) 
and (3.39) that if, in addition, x 2 < lun/(3 3 n, then 

P(bS n - jb 2 qV ln + ^b A q 2 V2n > x 2 ) 
l-*(ac) 

> exp{-Ax 3 p 3N /uj N - £ 2 N /2}[1 - {|O s | + \OQ\e E ^l 2 }xf3 m /uo N ] 

(3.40) 

> exp{-Aix 3 (3 3N /u; N }[l - A 2 x(3 3N /u N ] 

> exp{-A 3 x 3 (3 3N /u N }, 

by choosing rj sufficiently small. From (3.40), property (2.1) will follow if we 
prove that, for x 2 > un/P3N and 2 < x < tjuj^/ max/; |etfc|, 

( n AU P(bS n - tb 2 qV Xn + j x b\ 2 V 2n > x 2 ) 3 

(3.41) — — > exp{-Ac (5 3N uj n \. 

1 — &(x) 

We will prove (3.41) by using (3.29). Let A = 1 + 28x@ 3N /uj n , 6 = A£ and 
Ox = Aft. Note that 1 < A < 3/2 by (3.32), < 9 < 3/4 since < £ < 1/2 and 
\0i\ < 72 since < 36. By virtue of (3.26), (3.27), (3.32) and x 2 > iv N /f3 3N , 
we have m* N < X 2 x 2 + 24x 3 /3 3 n /ujn, cr* N <2x < 2x 3 f3 3 N /ojn and 

m* N - Ax 2 - 2a* N > A(A - l)x 2 - 28x 3 P 3N /lo n > 0. 

Now, by (3.29) with y = \x 2 and Lemma 3.4, for x 2 > ujn/ ' @ 3 n and 2 < x < 
ijlon/ maxfe \ak\, it follows that 

P{bS n - ib 2 qV ln + CibVV 2n > x 2 ) = P(T* > Ax 2 ) 

> i eX p{-m^ - 2a* N }Ee X p{T*} 

> |exp{-x 2 /2 - 2x - Ax 3 (3 3N /lu n } 

> (1- <S>(x))exp{-A lX 3 [3 3N /uj N }, 
which implies (3.41). The proof of Proposition 2.1 is now complete. 

4. Proof of Proposition 2.2. By the inequality (1 + y) 1 ^ 2 > 1 + y/2 — y 2 
for any y > —1, 

P(S n > Xy/qVn) 



= p(s„>x^(l + ^ r ^) ) 
< J°( S n > Xy/nq 



1 + Vln_Vl 

2n n 2 



(4.1) < P[V 2 n > 36x 2 {y^iXl - l) 2 + 5pJ>£ 



+ P[ S n >xy/fiq\l + 
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2n 



n- 



£(X 2 -l) 2 + 5p£4 

k=l J 



'■— Rln + R2n, 



say. 



Note that R 2n = P{bS n - \b 2 qV\ n + 36b 4 q 2 V2 n >x 2 - ho), where, whenever 
2 < x < (1/128)u;jv/ max& \ak\, we have 

180px 4 £4 , 36x 4 J2k=iE(X 2 -l) 2 < 3x s p 3N 



+ 



n- 



L0 N 



and also < ho < x 2 /5. It follows from Proposition 2.1 with £ = 1/2, £i = 36 
and h = ho that there exists an absolute constant ^4 > 128 such that, for all 
2 < x < (1/A)cjn/ maxfc |afc|, 



(4.2) 



R2n < (1 - $(x))exp{^x 3 /3 37V/wjv }. 



This, together with (4.1), implies that Proposition 2.2 will follow if we prove 
for all x > that 



(4.3) 



J Ri n <2v / 2e- 4a;2 . 



Theorem 2.1 of [12] will be used to prove (4.3). To use the theorem, let 
Y i = X 2 -l,A = £2=1 Y k and B = (2£J}=i y fc 2 + 4p£ a 4 ) 1 / 2 . It folloW s from 
Theorem 4 of [16] that, for any A £ R, 

f X 2 
Eex.pl XA-—B 



= expj 


U=i 


-A 2 n 2 )} 


< expj 


-2A 2 P ^4}[ii;exp{Ay 1 -A 2 y 1 2 }]" 


< expj 


-2A 2 P ^4}[i + i5;(Ay 1 /(Ay 1 


>"l/2))] 


= expj 


-2A 2 ^^4}[l-^(Ali/(Ayi 


< -1/2))] 


< expj 


-2A 2 p^4}[i + 2A 2 ii;y 1 2 ]" 




< expj 


-2A 2 p^4 + 2A 2 n£;y 2 } 




= expj 


-2A 2 p$>£ + 2A 2 p5>£-l) 


2 }<1, 



where we have used the inequality e x x < 1 + xl(x > —1/2). This yields 
that two random variables A and B > satisfy condition (1.4) in [12]. Now, 
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by noting that {EE) 2 < EE 2 < 6pJ2 a t an d applying Theorem 2.1 of [12], 
we have 

P (v ln > 6x (jr (X 2 - l) 2 + bp 4) ) 

<p(a>^b 2 + {ebA 

(4.4) 



< e-^/^EexpitA/^E 2 + (EE) 2 ) 

< v^e- 6 ^/^' 2 < V2e~ 4x \ 
by letting t = \/2x. Similarly, 

(4.5) P (- Vln > 6x (^2(X 2 k -l) 2 + 5 P J2aij ' ^j<V2e-^ 2 . 

By virtue of (4.4) and (4.5), we obtain (4.3). The proof of Proposition 2.2 
is now complete. 

5. Proof of Proposition 2.3. Throughout this section, let ej, 1 < j < N, 
be i.i.d. random variables with P(e\ = 1) = 1 — P(e\ = 0) = p, which are also 
independent of all other random variables, and Bjy = Y2jLi( £ j ~ p)- By the 
inequality (1 + y) 1 / 2 > 1 + y/2 — y 2 for any y > — 1, we again have 

P(S n > X^qV n ) 

= P(S n >Xy/nq(l + — 



n 

(5.1) = Pfe > *V^( 1 + ^ eki f k ~ l) 



2 
k 

2n 

2 1 \\2 



n 2 



/ 

P \^2( £ k-P)9k + — v k Vj>x-h 



B N = 
B N = 



= P(T N + A N >x- h\B N = 0), 
where h = xpqJ2(o- 2 — l) 2 /n 2 , 



T N = J2( £k ~P)9k, A N = — v k Vj, 

n i<k^j<N 
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where, for all j = 1, . . . , N, Uj = (ej — p)(aj — 1) and 

,2 



9j 



±= - X{ % ~ l) + X(1 - 2 2P) ((a] - I) 2 - ^ E(°2 - I) 2 



and where in the proof of (5.1) we have used the facts that J2 a k = 0, a t = 
N and 

(e k -p) 2 = e k (l - 2p) +p 2 = (e k -p)(l - 2p) +pg. 

We need the following lemmas before proceeding to the proof of Proposi- 
tion 2.3. 



(5.2) 



Lemma 5.1. For any random variable Z with E\Z\ < oo, 



E(Z\B N = 0) 



En{p) J 

where B n (p) = 2ttlunP(Bn = 0) and 
(5.3) 



EZ jtB N /u N dt 



1 < V2ir/B n {p) <1+uj 



N ■ 



Proof. Note that Bn = J2j=i £ j — n is an integer and, for any integer 



k, 



e m dt 



2ir, if k = 0, 
0, if k ^ 0. 



The proof of (5.2) is now obvious. The estimate for B n (p) follows from 
P(B N = 0) = { N n )p n q N - n and Stirling's formula. □ 

Lemma 5.2. (i) We have 
(5.4) e( WkVj\ 3/2 \B N = o) <An 2 (3 2 m , 



N 



(5.5) 



(5.6) 



E E 



N 



u k E ; 



E 



E v * v i 

l<k^j<N 



3/2 



3/2 



B N = 0) <An 2 p 2 N , 



B N = 0) <An 2 pl N . 



(ii) If r/fe, 1 < k < N, are i.i.d. random variables with 

P( Vk = 1) = 1 - P(r} k = 0) = m(t), < m(t) < 1, 
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independent of all other random variables, then 

3/2 \ 



(5.7) 

(5.8) E\ 



E 



^2 VkVj u ki 



B N = < Am\t)n 2 0- 



2p2 
3 AT; 



Vk(l ~ VjWvj 



3/2 



B N = I < Am(t)n 2 pi N . 



Proof. The proof of Lemma 5.2 is based on an argument similar to 
that in Theorem 4 of [16], together with the moment inequalities for i.i.d. 
random variables and [/-statistics. The details can be found in [18], on which 
the present paper is based. □ 

To introduce the following lemmas, we define 

f(t) = E(e u( - T - +A ^\B N = 0), h(t) = E(e itT -\B N = 0), 
f 2 (t) = E(A n e UT "\B N = 0) 

and, for k = 1, . . . , N, 

gk(t,i>) = Eexp{i(e k -p)(tg k + ip/u N )}. 
We also use the notation A = xP^n/^n- 

Lemma 5.3. // \t\ < (1/128)A _1 ; then for any < m(t) < 1 and for 
2 < x < (1/128)cjjv/ maxfc |afc|, 



(5.9) 



\f(t)\ <A(l + \tx\)[m~ 112 (t)e- m ^ t2 / 4 + w^e-CV^MtK ] 
+ A\t\ 3/2 m(t)A 2 + A\t\m A/3 {t)A^ 3 . 



Proof. Define {r]k,k = 1, . . . , N} as in Lemma 5.2(h). Furthermore, let 

T *N = % ( £ k - P)9k > T 2N = ( 1 ~ % ) ( £ k ~P)9k, 



A* 



^2 ll (1 - Vk)(l - Vj)"ki 



l<k^=j<N 



Note that 
(5.10) 



T N + A N = T? N + To N + Aijv + 2A97V + Aoat. 
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It follows from (5.10), \e u - 1| < \t\ and \e u -l-it\< 2|t| 3 / 2 that 
| /(f) | = \E(e it( - T *N +T 2N+ A iN+ 2A iN+ A tN)\B N = 0)| 

< \E(^ T *N+ T 2N+ 2A *2N+ A t N )\B N = 0)| + \t\E(\A* 1N \\B N = 0) 

< \E{^ t *n+ T 2n+ a In)\B n = 0)1 

(5.11) 

+ 2\t\\E{K* 2N e lt{T ^+ T 2N+ A lN)\B N = 0)| 
+ Sltl^^dA^I 3 / 2 !^ = 0) + \t\E{\A\ N \\B N = 0) 
:= Ei(t,x) + E 2 (t,x) + E 3 (t,x) + Ei(t,x). 

We first estimate H3(i, x) and E^fx). By Lemma 5.2(ii), we obtain that 
E(\A* 2N \ 3/2 \B N = 0) < Ax 3/2 m{t)n- 1 ^ N < Am(t)A 2 
and, by Holder's inequality, 

E(\A* 1N \\B N = 0) < [S(|A^| 3 / 2 |^ = 0)] 2 / 3 < V/ 3 (t)A 4 / 3 . 
These facts yield 

(5.12) 3 3 (t, x) + H 4 (t, x) < A|t| 3 / 2 m(t) A 2 + A|t|m 4/3 (t) A 4 / 3 . 

Next we estimate Hi (t, x) . Write S*^ = £ m( e k ~p) , B 2N = XX 1 - »7fc) ( £ fc ~ 
p) and 

(5.13) B = {k : r]k = 1}, B c = {fc:7fr = 0}. 
Note that, given r]i, . . . ,r)N, 

Tin > ^iV e , G -B}, r 2 V A^B^ G a{e fc , fc G 5 C } 

and Bn = B\ N + -Kjjjv- It follows that T* N and -BJjy are independent of 
-^2JV>-^3JV anc ^ -^2JV> gi ven Vli- ■ ■ iVNi an d hence, by Lemma 5.1, 

Ei(t,x) 

1 



(5.14) 



< 2 J E\E V exp{itT* N + iiJjB* 1N /u N }\ 

= 2 / ~[E\E v exp{ir] k (e k -p)(tg k + ip/u; N )}\di/j, 



<\ip\<Tnj N 

where E n denotes the conditional expectation given rj k ,k= 1, . . . , N . 
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Let e* k be an independent copy of e k . By Taylor's expansion of e JZ , 
E\E v exp{ir) k (e k -p)(tg k + tp/uj N )}\ 2 

= E(E rj exp{irj k (e k - e* k )(tg k + i/)/u N )}) 
= Eexp{ir] k (e k - e k )(tg k + tp/u N )} 

< 1 - (l/2)(tg k + ^/u> N fErjtE{e k - e* k ) 2 
+ (l/6)\tgk + ^/u N \ 3 E4E\e k - s* k \ 3 

< 1 -pqm(t)(tg k + tl;/uj N ) 2 + (pq/3)m(t)\tg k + i/j/uj n \ 3 . 

This, together with 9k = and the fact that for 2 < x < (l/128)wyv/ max^ \a k \, 

(5.15) \pq^2gl - 1 < 2x/3 3N /lo n and ^pq\g k \ 3 < 5(3 3N /lo n , 

yields that for 2<x< (1/128)uj n / max k \a k \,\t\ < (1/128) A" 1 and < 

(3/8)wjv, 

J(i,^) := Y[E\E ri eyip{ir] k (e k - p)(tg k + ip/uj N )}\ 

< (j[E\E v exp{ir] k (e k -p)(tg k + WW)}| 2 ) / 

< exp|-ipgm(t) ^(ififfc + i)/u) N ) 2 + \pqm{t) ^ |tg fc + V>/W | 3 } 

< exp{-( M /2)m(t) £ i 2 ^ - m(^ 2 /2 

(5.16) + (2pq/3)m(t) £ fe| 3 + (2/3)m(t)\iP\ 3 /u N } 

< exp{-(pg/2)m(t)^t 2 ^ + (2pq/3)m(t) ]T |i<? fc | 3 - m(^ 2 /4} 

< exp{-±m(t)t 2 (l - x(3 m /u; N - (5/3)\t\(3 3N /cu N ) - m{t)%b 2 /4} 

< exp{-m(t)t 2 /4 - m(t)tfj 2 /4:}. 

To estimate J(t,ijj) for (3/8)u;Ar < < ttojn-, we first note that 
E\E v exp{ir] k (e k - p){tg k + ip/u; N )}\ 2 
= Eexp{ir} k (e k - e* k ){tg k + ip/u> N )} 

(5.17) 

= 1 - 2pq + 2pqE cos[rj k (tg k + i/j/uj n )] 

= 1 — 2pqm{t) + 2pqm(t) cos(tg k + ip/u^). 

Define D = {A; : \g k \ < 2A} and D c = {k : \g k \ > 2A}. It is readily seen that 
for keD, \t\ < (1/128)A -1 and (3/8)u N < < ttlo n , 

If < tg k + ip/u N < vr + ^ or -± -tt <tg k + tp/u N < -§§ 
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and hence cosftg^ -\-^/lon) < cos(23/64) < 0.95. On the other hand, it fol- 
lows from (5.15) that for 2 < x < (1/128)1^/ max^ \a k \, 

A( Npq r^\ < ^k\ D <\ < y: ti 

U N keD c 

< (P9) _1 (l + 2x/? 3 7vMv) < 2( Pq y\ 

where \D C \ denotes the number of D c . Thus, \D C \ < N/2 and \D\ = N — 
\D C \ > N/2. By virtue of (5.17) and all of the above facts, we obtain that for 
\t\ < (1/128)A~ 1 , (3/8)to N < \tp\ < iruj N and 2 < x < (1/128)^/ max fc \a k \, 

JM) < (]l ElErjexpiirikiek-p^tgk + ii/ujN^A 
\keD J 

(5.18) < Yl exp{-pqm(t)[l - cos(tg k + i/j/uj n )]} 

keD 

<exp{-(l/40)m(t)u;^}. 

Combining (5.14), (5.16) and (5.18), it follows that for \t\ < (1/128)A" 1 
and 2 < x < (l/128)u;7v/ m a x fc |afc|, 

(5.19) Hi(t, x) < Am(t)-^ 2 e-^^ + Au N e~^ m ^ . 

Finally, we estimate ^{t, x). Note that A% N = ^ J2j£B c u j J2keB v k-> where 
B and B c are defined in (5.13). Similarly to (5.14), we have 

E 2 (t,x) = -^L / \E{Al N e it{T ^ +T ™ +K ™ )+i ^ BN/wN )\ 

B n{p) J\iI}\<ttuj n 



<^l E 



>^|^|<7rajjv 



J2 E-^hl 

.jeB c kt=B 



(5.20) x ^(^exp^tT^ + iil>B* m /u) N })\ 

dip 

4\t\xm(t) 



di\) 



\\t\x . 
< -Nr- / E 



J 1 1p | < ITU) JV 



4 \t \xm\t) x - . . . , f . , . 

< u 2 - Yl E \"j\ E \"k\ En jk (t,^)dij 

77 i^i /,.^ lr J \lj)\<.lTU)N 



where 



^jk(t,7p)= Y[ \ E riexp{iVl{ £ l-p)( t 9l + ' l P/uN)}\- 
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As in the proof of (5.19), with minor modifications, we have that for 
\t\ < (1/128)A _1 , 2 < x< (l/128)wAr/max fc |a fc | and all l<j^k<N, 

f EQ jk {t, VO # < im(t)" 1/2 e" m(t)(2/4 + A^ve- (1/40)m{t)t ^ . 

J|i/i|<7to;jv 

This, together with (5.20) and the fact that 

J2 E\uj\E\uk\ < (2pqJ2(4 + I))' = 16^, 

l<k^j<N 

yields that for 2 < x < (1/128)^/ max fc \a k \ and \t\ < (1/128) A -1 , 

(5.21) E 2 (t,x) < A\tx\{e- m ^ t2 ' A + u: N e-^^ m ^). 

Taking estimates (5.12), (5.19) and (5.21) into (5.11), we obtain (5.9). 
The proof of Lemma 5.3 is now complete. □ 

Lemma 5.4. Suppose that 2<x< (1/128)lun / max^ |ofc|. Then, for \t\ < 
(1/128)A~ 1 / 3 , 

(5.22) \fx(t) - e~ t2 / 2 \ < Amin{\t\, 1}(A(1 + t 6 )e"* 2 / 4 + a;/) 
and 

(5.23) \A(t) - g(t, 0)| < Amin{|t|, 1}(A 4 / 3 (1 + 1^^ + u,/), 
where 

g(t,0) = e- t2 l\\ + 5>*(t,0) - 1) + t 2 /2). 

Lemma 5.5. Suppose that 2 < x < (l/128)ojjv/ max^ \ak\- Then, for \t\ < 
(1/128)A~ 1 / 3 , 

(5.24) \f 2 (t)\ < A(l+t 2 )A 2 (e- t2 /4 + u; -6 )5 

(5.25) |/(0 - A (0| < AA 2 |f / 2 + ,4|t|(l +t 2 )A 2 (e-* 2 / 4 + <^ 6 ). 

The proofs of Lemmas 5.4 and 5.5 are omitted. The details can be found 
in [18], on which the present paper is based. 

Lemma 5.6. Suppose that 2 < x < (l/128)u;Ar/maxfc \a k \- Then there ex- 
ists an absolute constant A such that, for all \y\ < Ax, 

P{T N + A N > y\B N = 0) < (1 - $(y)) + AxAe~ y2/2 + AA 4 / 3 . 
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Proof. Note that Lemmas 5.3-5.5 are similar to Lemmas 10.1-10.3 in 
[19]. The proof of Lemma 5.6 is similar to Lemma 10.5 of [19] with some 
routine modifications. We omit the details. □ 

We are now ready to prove Proposition 2.3. Note that max|afc| < ujn, 
h = xpq\^(Oj. — I) 2 /n 2 < a; max \ak\P3N /n < A 
and \x — h\ < 2x. It follows from (5.1) and Lemma 5.6 that 
P(S n > Xy/qV n ) < P(T N + A N >x-h\B N = 0) 

< (1 - $(x - h)) + AxAe- {x ~ h)2/2 + AA 4 / 3 

< 1 - + A(l + x)Ae- x2 / 2+xA + AA^ 3 

< (1 - $(x))(l + Ax 2 Ae xA ) + AA A ' 3 

< (1 - exp{Ax 3 p 3N /uj N } + A{xf3 ZN /uj N fl 3 , 
where we have used the result 

$(x) - $(a -h)< m'(x -h)< he-^-^l 2 < Ae~ x2 / 2+xA . 
This yields Proposition 2.3. 

Acknowledgments. The authors would like to thank the referees and the 
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